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' Abstract 

One can recover sparse multivariate trigonometric polynomials from 
. . few randomly taken samples with high probability (as shown by Kunis and 

■^[^ ' Rauhut). We give a deterministic sampling of multivariate trigonometric 

, polynomials inspired by Weil's exponential sum. Our sampling can pro- 

duce a deterministic matrix satisfying the statistical restricted isometry 
property, and also nearly optimal Grassmannian frames. We show that 
, one can exactly reconstruct every M-sparse multivariate trigonometric 

polynomial with fixed degree and of length D from the determinant sam- 
pling X, using the orthogonal matching pursuit, and \X\ is a prime num- 
ber greater than (MlogD)^. This result is optimal within the (logD)^ 
04 ' factor. The simulations show that the deterministic sampling can offer 

^ , reconstruction performance similar to the random sampling. 

(N 

^ ! 1 Introduction 

I Wc investigate the problem of reconstructing sparse multivariate trigonometric 

o 



polynomials from few samples on [0, 1] . Let denote the space of all trigono- 
metric polynomials of maximal order q S N in dimension d. An element / of 
is of the form 



>< ■ fix) = J2 C'^e^-^'"' [0,1]^ 



where Ck G C. The dimension of will be denoted by D := {2q + 1^. We 
denote the support of the sequence of coefficients of Ck by T, i.e., 

T := {k : Ck + 0}. 

Throughout this paper, we will mainly deal with "sparse" trigonometric poly- 
nomials, i.e., we assume that |T| is much smaller than the dimension of D of 
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n^. We set 

n^(M) := U Ht, 

T I < A/ 

where, IIt denotes the space of all trigonometric polynomials whose coefficients 
are supported on T. Note that the set n^(M) is the union of linear spaces 
and consists of all trigonometric polynomials whose Fourier coefficients are sup- 
ported on a set T C [—q,q]'^ n Z'* satisfying |T| < M. The aim of the paper 
is to sample a trigonometric polynomial / € 11^ (M) at N points and try to 
reconstruct / from these samples. We denote the sampling set 

X := {a;i,...,a;Ar}. 

We would like to reconstruct / G n^(M) from its sample values 

y = f{x), xeX. 

We use a decoder A that maps from C''^ to 11^, and the role of A is to provide 
an approximation to /. The previous work concerns on the randomly taken 
samples. In [31I3], the authors choose X by takeing samples randomly on a 
lattice and use the Basis Pursuit (BP) as the decoder A. In [16], the result is 
generalized for the case of xi, . . . , xn being the uniform distribution on [0, 1]''. 
We state the result as follows: 

Theorem 1.1. U6^ Assume f e n^(A/) for some sparsity M G N. Let 
Xi, . . . , Xn G [0,1]'* be independent random variables having the uniform dis- 
tribution on [0, l]"*. If for some e > it holds 

N > CM\og{D/e) 

then with probability at least 1— e the trigonometric polynomial f can be recovered 
from its sample values f{xj), j = 1, . . . ,N, by Basis Pursuit. The constant C 
is absolute. 

In [2], one chooses A as Orthogonal Matching Pursuit (Algorithm 1) and 
X is chosen according to one of two probability models: 

(1) The sampling points Xi, . . . , xjv are independent random variable having 
the uniform distribution on [0, l]''; 

(2) The sampling points xi, . . . ,xis[ have the uniform distribution on the 
finite set 27rZf„/m for some m e N \ {1}. 

Theorem 1.2. jlfj Let X = {xi, . . . , x^) be chosen according to one of two 
probability models. Suppose that 

N > CM^\og{D/e). 

Then, with probability at least 1 — e, OMP recovers every M -sparse trigonometric 
polynomial. The constant C is absolute. 
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Algorithm 1 Orthogonal Matching Pursuit 

Input: sampling matrix Tx^ sampling vector y = {f{xj))jLi, maximum 
allowed sparsity M or residula tolerance e 
Output: the Fourier coefficients c and its support T. 
Initialize: r" c° = 0, A° = 0, ^ = 0. 
while ||r^||2 > e or £ < M do 
match: = J-]^r^ 

identity: A'^^^ = U {argmax^ |/i^(j)|} 
update: c''+i = argmin^.,^,pp(^)cA'+i ||y - J'x^^lb 
=y- Fxc'+^ 

end while 



The aim of this paper are twofold. First, we present a deterministic sampling 
X and show that OMP can recover every / € n^(M) exactly using X with \X\ 
being a prime number greater than C(M log D)^, provided q is fixed. So, we 
improve Theorem 11.21 Second, we construct a StRIP matrix with large range 
size. In particular, we exploit the connections between the exponential sum and 
the RIP matrix. 

We now discuss the organization of this paper and we summarize its main 
contributions. In Section 2, we introduce the deterministic sampling and show 
that the coherence of the corresponding sampling matrix less or equal to {d — 1)/\/N 
provided > 2q + l and A^ is a prime number. As a conclusion, OMP algorithm 
can recover / € n^(M) exactly when N > {d- 1)2(2M -1)^ + 1 with the addi- 
tional assumption of N being prime number not less than 2q+l. One has shown 
that if Af < CM^^"^, then with high probability there exists an Af-sparsc coeffi- 
cient vector c depending on the sampling set such that OMP fails (one also be- 
lieves that the bound can be improved to 0{AP) ) (see [15]). So, if one requires 
exactly recover of all sparse trigonometric polynomials from a single sampling 
set X , within the factor log^ D, our deterministic sampling size almost meets the 
optimal bound for / e 11^ (M) where q is fixed and d is variable. In Section 3, 
we show that the N x D determining sampling matrix obeys the Statistical Re- 
stricted Isometry Property (StRIP) of order 0(A^(log(i:)/A^))V(log-D(log Af)^)). 
Though there are many deterministic sensing matrixes satisfying the StRIP [5ll8] , 
the restriction to the size of our matrixes is light comparing with them. More- 
over, the StRIP matrix also implies nearly optimal Grassmannian frames. In 
Section 4, we show that the deterministic sampling can provide similar recon- 
struction performance to that of the random ones by numerical experiments. 
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2 Deterministic sampling 



2.1 Exponential sums and sampling matrixes 

We first introduce a result in number theory, which plays a center role in our 
determinant sampling. 

Theorem 2.1. \20f Suppose that p is a prime number. Suppose f{x) = mix + 
■ ■ ■ + rridx'^ and there is a j , 1 < J < d, so that p \ rnj . Then 



< id-l)VP- 



We furthermore introduce the definition of mutual incoherence. Let ma- 
trix A = (ai,...,aD) G C^""^, where N < D and \\a,\\2 = 1. The mutual 
incoherence of A is defined by 

M{A) :~ max. {ai, a j) . 
The low bound of Ai{A), which is also called as Welch's bound, is given in [21] 

M{A) > 



D-N 



{N - l)D 



(1) 



If the equality holds, we call A as optimal Grassmannian frames. As shown 
in [7j, the equality can hold only ii D < N'^ (sec also ^19|). Suppose that 
TV > 2g + 1 is a prime number. Wc choose the sampling set X ~ {xi, . . . , xn} 
with 

Xj = ij,f,...,/)/N modi, j-l,...,iV, (2) 
and denote by the N x D sampling matrix with entries 

{J'x)j,k = exp {2nik ■ Xj), j ^1,...,N, ke [-q, qf. 

Also, f{xj) ~ {Txcjj, where c is the vector of Fourier coefficients of /. We let 
denote the fc-th column of J^x- A simple observation is ||</'fc||2 = \/iV. Set 



li:=MiTx/VN). 

Then we have 
Lemma 2.2. 

M < {d-l)/VN. 
Proof. Recall that (pk denotes the A;-th column of J^x- Note that 

JV 



3=1 



27Tipij)/N 
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where p is a polynomial with degree d in the form of (m 
m,k E [—q, g]''. Then Theorem 12. II implies that 



k) ■ [j 



/,•••,/) with 



|(0m,</'fc>| < {d-l)^, for m^k. 



Hence, 



Ai = max((^„,0fe)/iV < {d-l)/^/N. 



□ 



Let us consider recovery by OMP using the deterministic sampling X. We 
first recall the following theorem: 

Theorem 2.3. Assume {2M-l)^ < 1. Then OMP (and also BP) recovers 
every f G 11^ (M). 

Combining Lemma and Theorem 12.31 we have 

Theorem 2.4. Let the sampling set X ~ {xi, . . . , xn} with 



Suppose N > max{2g + 1, (c? — 1)^(2A/ — 1)^ + 1} and N is a prime number. 
Then OMP (and also BP) recovers every M -sparse trigonometric polynomial 
exactly from the determinant sampling X . 

2.2 Special sparsity patterns 

For the deterministic sampling X, in Theorem 12. 4| an additional assumption 
is that N > 2g + 1 = D^^'^. Hence, only when q is fixed and d is a vari- 
able, we can say that max{2g + 1, {M{d — 1))^} = 0(Ajf logD)^. However, if 
a prior information about the support of / is known, the restriction might be 
reduced. For F C [—q,q]'^ H Z'', recall that we use Hr to denote the space of 
all trigonometric polynomials in dimension d whose coefficients are supported 
on F. We let /3r be the minimum constant so that, for any fci,fc2 G F with 
ki ^ ^2, there exists a non-zero entry of the vector fci — ^2, say kij — fc2,j, such 
that < \ki,j — /c2j"| < /3r- Then, for / € Hr, we can replace the condition 
N > 2q + 1 in Theorem 12.41 bv > /3r + 1- For example, we suppose that Fq 
is a 'curve' in [— q, q]"^, which is defined by 



Then a simple argument shows that /3to ^ (2? + 1)^^''. Hence, OMP can 
recover Af-sparse trigonometric polynomials / € Hpo exactly from determinant 
sampling X with > max{(2g + 1)1/'^, {d- 1)2(2M - 1)^ + 1} and N being a 
prime number. In particular, if rf > log2(2(7 + 1), the condition N > {2q + 1)^/'' 
is reduced to TV > 2. 



Xj = {j,j^...,f)/N modi, j = l,...,iV. 
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2.3 Related work 



We are not the only ones seeking the deterministic Fourier samphng. We would 
especially like to note works by Iwen [TIHn] and Bourgain et al [2]. In [TT], 
a deterministic Fourier sampling method is considered and a sublinear-time 
algorithm which recovers one dimensional sparse trigonometric polynomials / is 
presented. However, the sampling in need a combinatorial structure, which 
seems non-trivial to be constructed. Moreover, the coherence of the sampling 
matrix in [TT] is not small. In recent work [T21II3], Iwen presents a binary 
matrix, say B, with small coherence. By computing the product of B and the 
discrete Fourier matrix ^P, one can obtain a deterministic sampling matrix B-"^ . 
However, the construction of B requires 0{M log D) large primes and one also 
needs a fast algorithm for computing the product of B and 

Our work is in a different direction. The main concern of our methods is 
to present a determinist sampling with an analytic form so that the coherence 
of the sampling matrix is as small as possible and hence the popular decoder 
algorithms, such as OMP and BP, can work well for the sampling. In fact, to 
construct our deterministic sampling, we only require a prime number N. The 
coherence of our deterministic sampling matrix almost meets the Welch's bound. 
Hence, we also present a nearly optimal harmonic Grassmannian frames, which 
may be of independent interest |19| . We also point out another difference be- 
tween our study and that of Iwen. The deterministic sampling given in |11H13) 
is designed for trigonometric polynomials in a single variable. In [13], the author 
shows that one can deal with high dimensional trigonometric polynomials by 
a dimensionality reduction technique, but it requires the integer solutions of a 
linear equation and hence it is an indirectly method. In contrast, our sampling 
is much more convenient for dealing with high dimensional trigonometric poly- 
nomials. The last, but not least, it seems that in practice the algorithms given 
in [TT1[T3] require much more samples than OMP and BP when the dimension 
d is large. 

We next compare our study and that of Bourgain et al. In [2] , for the case 
with d = 1, Bourgain et al show a connection between the deterministic Fourier 
sampling and Turan's problem, and also present many possible approaches to 
constructing the sampling. Comparing with the approaches given in [2], our 
sampling has the advantage of simplicity. Another important distinction is that 
our sampling strategy can be interpretable as a sampling strategy for recovering 
higher dimensional sparse trigonometric polynomials. 

Finally, we would like to point out connections with chirp sensing codes. 
In [1] , a X iV^ measurement matrix O is designed with chirp sequences forming 
the columns, i.e., 

{e)i^k = exp(27rirf2/7V) exp(27rim^/iV) with 1 < £ < and fc = Nr+m, 1 <k < N^. 

If we take d = 2, then Tx is reduced to the chirp sensing matrix O. Hence, the 
measurement matrix O can be considered as a special case of our determinant 
sampling matrix J^x- Noting that the coherence of the matrix M{Tx / VN) 
is not more than {d — l)/y/N, by an argument similar to one employed by 
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DeVore in [5] , we can show that Tx / ^J~^ satisfies RIP of order fc with constant 
6 = {k — l){d — 1)/^/N (the definition of RIP is given in the next section). For 
fixed < (5 < 1, we can obtain the up bound k = 0{^/N /d). Using the method 
of additive combinatorics, in [2], Bourgain et al investigate the RIP property 
of 9 and show that one can construct N x D RIP matrixes of order k with 
N = o(fc^), which imphes that a better up bound of k. It wiU be a challenging 
problem to extend the result in [2] to the matrix J-x ■ 

3 RIP and StRIP 

Given a. N x D matrix $ and any set T of column indices, we denote by <&t 
the n X \T\ matrix composed of these columns. Similarly, for a vector y S C^, 
we use ut to denote the vector formed by the entries of y with indices from 
T. Following Candes and Tao, we say that $ satisfies the Restricted Isometry 
Property (RIP) of order k and constant 6 £ (0, 1) if 

(1 - myrf < W'^TUrf < (1 + <5)||yT||' (3) 

holds for all sets T with |T| < k. In fact, ([3]) is equivalent to requiring that the 
Grammian matrices $f <I>t has all of its eigenvalues in [1 — 6,1 + S] for all T 
with \T\ < k. A fundamental question in compressed sensing is the construction 
of suitable RIP matrix $. In general, RIP matrices can be constructed using 
random variables such as Gaussian or Bernoulli as their entries. However, the 
construction of the deterministic RIP matrices is a challenging task (see also 
[2j|6]). Given that there are no satisfying deterministic construction of RIP 
matrices, several authors suggest an alternative statistical version of RIP [SlITU]: 

Definition 3.1. We say that a deterministic matrix $ satisfies statistical re- 
stricted isometry property (StRIP) of order k with constant 6 and probability 
1-e if 

PvilW'f yf - \\yf\ < 5\\yf) > I - e, 

with respect to a uniform distribution of the vectors y among all fc-sparse vectors 
in of the same norm. 

In [8], the authors derive the StRIP performance bound in terms of the 
mutual coherence of the sampling matrix and the sparsity level of input signal, 
as summarized by the following theorem: 

Tiieorem 3.2. fS^ Let $ = {4>i, . . . , (pu) be an N x D deterministic matrix, 
where each column has unit norm. Assume further that all row sums of $ are 
equal to zero, and A^($) < ai/\/N , where ai is some constant. Then $ is 
a StRIP of order k < co{S)N/ logD with constant S and probability 1 — l/D, 
where co{S) = d'^/{8al). 

As stated in [5l[8l[T0], there are a large class of deterministic matrices which 
satisfy the StRIP. However, the restriction on the size {N and D) is heavy. 
For example, FZC Codes [l7j require that D = N'^ and is a prime number; 
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Gold/ Gold-like Codes [H] require that D = {N + 1)^ and N is in the form of 
2^ — l,p £ Z, and so on. We next construct a deterministic StRIP matrix with 
the large range size based on the method introduced in Section 2. 

Suppose G N is a prime number. We suppose that D G N can be written 
in the form of D = pi • • • p^, where N = pi > p2 > ■ ■ ■ > Pd ^ '2 and pi, . . . ,pd 
are prime numbers. For t = 1, . . . , d, we set 

J fh(pt-l)/2,(pi-l)/2], pt^2, 
* ■ \[0,1], pt = 2. 

Recall that 

x,^ij,f,...J'')/N modl,j = l,...,iV, 
and denote by J-x the N x D matrix with entries 

i^x)j,k = exp {2'Kik -xj), j = 1,...,N, k e h x h x ■ ■ ■ x Id- 

Theorem 3.3. Suppose that < S < 1 is given. The matrix $ := J^x/V^ is a 
StRIP of order 5^ s(^i^gD) ("To^F"^) with constant 6 and probability 1 — 1/D. 

Proof. Wc denote the mutual coherence of $ by fl. Using the same method 
with the proof of Lemma [2.21 we obtain that jl < {d — 1)/\/N. Note that the 

all row sums of Px is 0, and also that {d — 1)^ > ^ iog{ d^n) ) • "^^^ conclusion 
can follow from Theorem 13.21 directly. □ 

Remark 3.4. When D ^ N, the Welch's bound (IT} approximately equals to 
1/VN. Note that 



<{d- 1)/VN < \og2 D/VN. 

The mutual incoherence of $ almost meets the Welch's bound, which implies 
that $ is a nearly optimal harmonic Grassmannian frame (see |19]). 



4 Numerical Experiments 

The purpose of the experiment is the comparison for the random sampling and 
the determinant sampling. Given the degree of trigonometric polynomials q G N 
and the number of variables d € N, the support set T is drawn from the uniform 
distribution over the set of all subsets of [—q, q]"^ of size M. The non-zero 
Fourier coefficients, the real as well as the imaginary part of Cj,j G T, have 
the Gaussian distribution with mean zero and standard deviation one. For the 
determinant sampling, we use the method introduced in Section 2 to produce 
the sampling points Xj,j ~ 1, . . . ,N. Similar with [Tl], we choose the random 
sampling points based on the continuous probability model. 
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Example 4.1. We take q = 2,d = 5, D = 3125 and draw a set T of size 
M g {1, 2, . . . , 40}. The A'' = 83 deterministic sampling points are obtained 
by the method introduced in Section 2, and the random samphng points are 
produced by the continuous probability model. We reconstruct the Fourier 
coefficients by OMP and BP, respectively. In [T^, the complexity of OMP is 
analysised in detail. For BP, we use the optimization tools of CVX [3]. We 
repeat the experiment 100 times for each number M and calculate the success 
rate. Figure 1 and Figure 2 depict the numerical results with the reconstructing 
algorithm OMP and BP, respectively. From these, one can observe that the 
performance of deterministic sampling is very similar to those of the random 
sampling. The numerical experiments imply the promising application of the 
deterministic sampling. 




5 10 15 20 25 30 35 40 



Figure 1: Simulation results using 
the OMP 




Figure 2: Simulation results using 
the BP 



Example 4.2. As said before, RIP of order k with constant S is equivalent 
to requiring that the Grammian matrices has all of its eigenvalues in 

[1 — (5, 1 + (5] for all T with \T\ < k. So, the purpose of the second experiment is 
the comparison for the maximum and minimum eigenvalue statistics of Gram 
matrices ^J^t of varying sparsity M := \T\ for deterministic sampling matrix 
and random sampling matrix. In order to do this, for every value M, sets T 
are drawn uniformly random over all sets and the statistics are accumulated 
from 50,000 samples. Figure 3 shows the sample means of the maximum and 
minimum eigenvalues of ^J^t for M G {1, . . . , 20}. 

Acknowledgments. Wc would like to thank the referees for valuable com- 
ments on this paper. 
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Figure 3: Eigenvalue statistics of Gram matrices $f $t for deterministic sam- 
pling matrixes and random sampling matrixes 
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